Absence of an equilibrium ferromagnetic spin glass phase in three dimensions 
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Using ground state computations, we study the transition from a spin glass to a ferromagnet in 
3-d spin glasses when changing the mean value of the spin-spin interaction. We find good evidence 
for replica symmetry breaking up till the critical value where ferromagnetic ordering sets in, and no 
ferromagnetic spin glass phase. This phase diagram is in conflict with the droplet/scaling and mean 
field theories of spin glasses. We also find that the exponents of the second order ferromagnetic 
transition do not depend on the microscopic Hamiltonian, suggesting universality of this transition. 
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The nature of the frozen phase in finite dimensional 
spin glasses [1] is still not understood. Many studies 
seem to support the many valley picture predicted by 
the mean field approach [2,3] in which replica symmetry 
is broken (RSB). Nevertheless other approaches [4,5] are 
not excluded; one open question is whether spin glass or- 
dering can co-exist with ferromagnetism. The different 
theoretical predictions here are in conflict. Moreover, this 
question is of experimental relevance: it may be possible 
to test for the co-existence of the two types of orderings 
in doped ferromagnets that show glassy behavior. 

In this paper we study the transition from a spin glass 
to a ferromagnet at zero-temperature for Ising spin mod- 
els having nearest and next-nearest neighbor interactions 
in d = 3. First, we find that RSB, which is associated 
with system-size excitations having O(l) energies, per- 
sists in the presence of an excess of ferromagnetic over 
anti- ferromagnetic bonds. Second, our order parameter 
for RSB vanishes at the same concentration as where fer- 
romagnetism sets in; in fact it seems that ferromagnetic 
and spin glass orderings, with or without RSB, do not 
co-exist. These properties are in conflict with the mean 
field and droplet/scaling theories [4,5], the main theo- 
retical frameworks for spin glasses. Finally, the critical 
exponents and Binder cumulant at criticality for the fer- 
romagnetic transition are the same for our two models, 
and fully compatible with those found in a similar sys- 
tem [6], giving evidence for universality in this transition. 

Theoretical expectations — In the mean field picture, 
based on the infinite range Sherrington-Kirkpatrick (SK) 
model [7] , one has the following sequence at low temper- 
ature when the concentration of ferromagnetic interac- 
tions is increased (see Fig. 1): (a) an RSB phase with 
no magnetization (m = 0); (b) a "mixed" phase with 
both RSB and m > 0; (c) a standard ferromagnetic 
phase. The same phase diagram arises in the Random 
Energy Model [8]. In these models the mixed phase fol- 
lows from the existence of a spin glass phase in a mag- 
netic field; indeed, a non zero magnetization creates an 
effective magnetic field, and thus mixed phases seem un- 
avoidable in mean field. One can also consider finite con- 
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FIG. 1. Left: Phase diagram in a mean-field model (p is 
the excess concentration of ferromagnetic bonds, c.f. eq. 1). 
A mixed (M) phase, with both ferromagnetic (F) ordering 
and replica symmetry breaking (RSB), is present. At larger 
temperature the system is paramagnetic (P). Right: The role 
of the coordination on the presence of such a mixed phase in 
the mean field picture at temperature T — (artist's view). 



nectivity generalizations [9,10] of the SK model where a 
spin is connected at random to a finite number of other 
spins. A study of the associated phase diagram has been 
performed [11] for connectivity 3 and again shows the 
presence of a mixed phase, while the limit of large con- 
nectivities brings us back to the SK model. Now the com- 
bination of spin glass ordering and very low connectivity 
most likely inhibits ferromagnetism, so the size of the 
mixed phase should grow as the connectivity increases. 
This is what we illustrate in Fig. 1 . If mean field is a good 
guide for three dimensions, then a mixed phase should be 
easier to observe on lattices with large connectivities; for 
this reason we shall consider lattices with next-nearest 
neighbor interactions. 

Within the droplet or scaling theories, the phase dia- 
gram is very different because any magnetic field destroys 
the spin glass ordering. For instance, within the droplet 
picture [4] , the mixed phase is incompatible with compact 
droplets. Similarly, within the scaling picture [5], having 
a mixed phase would require a line of neutral fixed points 
connecting two unstable fixed points under the renormal- 
ization group, i.e., highly singular and non generic flows. 
Not surprizingly, the absence of a mixed phase is ex- 
plicitly confirmed in the Migdal-Kadanoff bond-moving 
approach [12,13]. This picture works very well in low 
dimensions, and in particular it agrees with the consen- 
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FIG. 2. Scaling plot of m as a function of p in the First 
Neighbor Model; p F = 0.385, v = 0.9 and /3 = 0.3. The inset 
shows the Binder cumulant of mj. 
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FIG. 3. Scaling plot of the mean value of m as a function 
of p in the Second Neighbor Model; pf = 0.236, v — 0.9 and 
/3 = 0.3. The inset shows the Binder cumulant of mj. 



sus of no mixed phase in dimensions d < 2 [14,15]. Our 
focus in this work is the case d = 3 where the question 
of a mixed phase remains open. Note that high temper- 
ature series cannot address this problem as the mixed 
phase resides beyond the first boundary of singularities. 
A good way to tackle it is via Monte Carlo; unfortunately, 
such studies have systematically avoided the question of 
the mixed phase, focusing instead on ordering from the 
paramagnetic side. The only attempt to search for an 
equilibrium mixed phase we are aware of is that of Hart- 
mann [6] who worked at zero-temperature but was not 
able to estimate precisely the boundary of the spin glass 
phase and thus made no claims about the existence or 
not of a mixed phase. 

The models - We consider Edwards-Anderson-likc 
Hamiltonians on a L x L x L cubic lattice: 

Hj({Si}) = (1 - p) J2 JaSiSj - P J2 S ^ (!) 



<ij> 



<ij> 



where Si = ±1 are Ising spins and p controls the amount 
of frustration in the system. The sums are over all nearest 
neighbor spins in the First Neighbor Model (FNM), and 
over nearest and next-nearest neighbor spins (a total of 
18) in the Second Neighbor Model (SNM). The quenched 
couplings Jij are independent random variables, taken 
from a Gaussian distribution of zero mean and unit vari- 
ance and we impose periodic boundary conditions. This 
Hamiltonian has both a spin glass term and a ferromag- 
netic term; for p = we recover the standard spin glass 
model while for p = 1 we have the usual Ising ferro- 
magnet. We use sizes up to L = 12 for the FNM and 
up to L = 8 for the SNM. At these sizes, the heuristic 
algorithm [16] we use gives the ground state with very 
high probability so that our systematic errors are much 
smaller than our statistical ones. 

Ferromagnetic ordering - We first focus on the tran- 
sition from a state where the magnetization per spin m 
is zero to a ferromagnetic state (m ^ 0). Note that the 



Hamiltonian has the global symmetry {Si} — > {—Si}, 
so m is an order parameter for the transition. For each 
instance, we determine the magnetization density ±mj 
(since the Jij are independent continuous random vari- 
ables, there are only two ground states, related by sym- 
metry). Our order parameter is then 



m 



1/2 



(2) 



where • denotes the average over the disorder variables 

For a large excess of ferromagnetic interactions (p w 1), 
m will be close to 1, while for a small excess (p w 0), m 
will go to zero in the large volume limit. For both the 
FNM and SNM, the transition appears to be of second 
order; indeed our distributions of |toj| always have a sin- 
gle peak whereas a first order transition should lead to 
two peaks at the transition point, one at m > and one 
at m — 0. (These two peaks would be generated by those 
samples that are magnetized and those that arc not.) To 
determine the critical value pp-, we have computed the 
Binder cumulant associated with the distribution of raj: 



9 (P. L) = - 
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(3) 



The different L curves cross very well for both mod- 
els, giving p% NM = 0.385(5) and pf NM = 0.236(5). 
Moreover, applying finite size scaling, we should have 
g (p, L) = g {L}l v (p — Pf)) ■ Doing so for the order pa- 
rameter, we expect m (p, L) = L~ fi l v F (p — Pf))- 
The corresponding data collapse is very satisfactory as 
can be seen in Fig. 2 and 3. Furthermore, the values of 
the critical exponents are close for the two models: we 
find /? = 0.3(1) and v = 0.9(2). These values are within 
the error bars of those found by Hartmann who studied 
the case where Jij = ±1 [6], obtaining (3 = 0.2(1) and 
v = 1.1(3). Last but not least, the values of the Binder 



2 



cumulant at the critical point are all close to one-another. 
These results give evidence in favor of universality in spin 
glasses, at least for this particular transition. 

Replica symmetry breaking and sponges - RSB lit- 
erally means that P(q), the probability distribution of 
spin overlaps taken between equilibrium configurations 
is not concentrated as in a ferromagnet. Unfortunately 
estimations of P(q) are plagued by finite size effets. Hart- 
mann [6] measured the width of P(q) among ground 
states of the ±J model but, because of subtleties intrin- 
sic to that model, he was not able to determine the lo- 
cation of the spin glass phase boundary and thus made 
no claims about the existence of a mixed phase. In our 
work we use a different probe of RSB that seems to suffer 
far less from finite size effects. The starting point is to 
remark that in the presence of RSB several macroscop- 
ically different valleys dominate the system's partition 
function, having 0(1) differences in free-energy. Extrap- 
olating such behavior to zero-temperature, we expect to 
have system-size excitations above the ground state cost- 
ing only O(l) in energy. In our models, we characterize 
the system-size excitations by their topology, following 
the procedures developped in [17]. First, we produce an 
excitation by taking at random 2 spins in the ground 
state, forcing them to change their relative orientation, 
and recomputing the new ground state with that con- 
straint. By definition, the spins that are flipped in an 
excitation form a connected cluster; if it and its comple- 
ment "wind" around in all three (x,y,z) directions, we 
call it a sponge. (For instance a cluster winds in the x di- 
rection if there exists a closed walk on it having non-zero 
winding number in x.) We use the proportion of such 
sponge-like (topologically non-trivial) events as an order 
parameter for RSB. In the droplet model, this quantity 
decays as L~ 6 so asymptotically there are no large scale 
0(1) excitations. As in [17], we increased the signal to 
noise ratio by first ranking the spins according to their 
local field; then we took the two spins at random from the 
list's top 25% (or 50%, both led to the same conclusions). 

We have measured this order parameter as a function 
of p and L. Our results are very similar in the FNM and 
the SNM. Looking at the plot in Fig. 4, there seems to 
be a phase transition in the FNM at p^^f w 0.380(5). 
Fitting these curves leads unambiguously to a non-zero 
large L value for the order parameter when p = 0.37 and 
to a zero value when p = 0.39. In the SNM (see inset of 
Fig. 4), we find p^g ~ 0.235(5) and the extrapolations 
away from this point behave as in the FNM. Note that, 
within statistical errors, the curves have a common cross- 
ing point. Furthermore, just as for p = 0, up to the tran- 
sition point the fraction of sponge-like events increases 
with L. It thus seems most likely that these excitations 
survive as L — ► oo if p < prsb- This is as expected in the 
mean field approach, but not in the droplet/scaling pic- 
tures. However, the transition point prsb is close if not 
equal to pf in both of our models, so it seems to us that 




FIG. 4. Fraction of sponge-like excitations versus p in 
the FNM. (The inset shows the data for the SNM.) 
0.380(5) (pgf|f = 0.235(5)). 
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there is no mixed phase having both sponge excitations 
and positive magnetization. This would be in contrast to 
the mean field prediction. 

Domain wall wandering and 6*dw ~ We now study 
directly the spin glass ordering, be-it with or without 
RSB, so we no longer resort to 0(1) energy sponges. It is 
well known that spin glass ordering is sensitive to pertur- 
bations; the standard probe for this consists in compar- 
ing periodic and anti-periodic boundary conditions [5], 
thereby creating an interface in the system. The typical 
energy change for such a modification of boundary con- 
ditions should grow more slowly than L 2 in the spin glass 
phase, with 0(1) energy changes arising not too rarely, 
for instance with a probability going as an inverse power 
of L. Another important aspect of such an interface is 
associated with its position space properties: in a spin 
glass phase, it is "space spanning". This can be made 
precise algorithmically by considering whether the inter- 
face winds around the whole lattice. We take this behav- 
ior to be an indication of the "fragility" of the ground 
state; we thus consider that we are in a spin glass phase 
when there is a positive probability that the interface is 
"spongy", i.e., winds around the lattice. 

We begin with the FNM. In Fig. 5 we show the frac- 
tion of instances where the interface is spongy. The 
data suggest a transition at pdw<0.4. However there 
is a systematic drift of the crossing points to the left so 
the most straight-forward interpretation of our results is 
Prsb = Pf = Pdw', then the spin glass ordering disap- 
pears when the ferromagnetic ordering appears, the two 
orderings do not co-exist and there is no mixed phase. 

If on the other hand one really believes mean field to 
be a good guide, one can assume that the mixed phase is 
present but only in a very small window, something like 
p G [0.38, 0.40]. To make such a window larger and thus 
to give creadence in favor of a mixed phase, we increase 
the connectivity of the lattice from 6 to 18 by going to 
the SNM. There, our analysis leads to pdw < 0.255; thus 
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FIG. 5. Fraction of spongy interfaces versus p in the FNM. 
(The inset shows the data for the SNM.) The crossing points 
drift to the left, suggesting pDW ~ Prsb- 



Carlo simulations, are needed. On the analytical side, a 
computation of the phase diagram on the Bethe lattice 
with RSB [19], or field theoric approaches for the mixed 
phase in the spirit of [20] , would be welcome. Finally, ex- 
perimentally, it may be possible to test whether magneti- 
zation and spin glass ordering can co-exist in equilibrium; 
however this will require careful checks that equilibrium 
is indeed reached. 
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in this "improved" model, the most optimistic estimate 
for the window would be p € [0.236, 0.255]. However just 
as in the FNM, the crossing points of the curves drift and 
again pdw — Prsb is very small if not zero, a result quite 
puzzling from the mean field perspective, not to mention 
the fact that RSB seems to be excluded in this window. 

To pursue the search for a mixed phase, we have stud- 
ied the FNM in d = 4 for sizes L < 5. The behavior is 
similar to the case d — 3, and in particular we obtain 
Pf = 0.315(5) and prsb = 0.325(5) (data not shown). 
But the crossing points of the Binder cumulant which 
determine pf now shift towards larger values as L in- 
creases. As a result, there is no compelling evidence for 
a mixed phase and probably pnw — Pf = Prsb- 

Discussion and conclusions - In spite of our at- 
tempts to render finite dimensional models mean-ficld- 
like, we are unable to confirm the mean field prediction 
that RSB and ferromagnetic order can co-exist. Since 
we also find quite clear signals for RSB via the existence 
of spongy clusters having 0(1) energies in the whole un- 
magnetized region, we cannot explain our results using 
the droplet/scaling theories either. (There is no RSB 
in those approaches.) Interestingly, all the results we 
obtain are compatible with the "Trivial-Non- Trivial" or 
TNT picture [17,18]. In that picture, there are system- 
size excitations whose energies are O(l); this leads to 
RSB, i.e. a non-trivial distribution of spin overlaps. Fur- 
thermore, they are also compact, with a surface fractal 
dimension d s < d, leading to a trivial distribution of link 
overlaps. This TNT picture forbids a mixed phase as fol- 
lows. Assume that the local magnetization density (in 
a big enough sub-volume of the whole) is self-averaging 
and equal to the global magnetization density. Activat- 
ing compact system-size excitations will not affect the 
local magnetization but will change the global one unless 
m = 0. A well behaved magnetization with TNT then 
forces m = 0, i.e., no mixed phase. 

Other numerical studies, in particular based on Montc- 
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